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Introduction 


• The goal in designing a coded modulation 
system is to achieve a good trade-off 
between coding gain, decoding complexity, 
and decoding delay. 

• Multi-level coding is a powerful technique 
for constructing bandwidth efficient coded 
modulation codes. Good multi-level coding 
schemes can be designed by using previously 
known codes as component codes. 

• Multi-stage decoding provides a simple 
decoder implementation for multi-level 
codes with a small loss in coding gain. 

• For coded QAM, the total power gain over 
uncoded QAM is composed of two parts: 
the coding gain (7(C)) and the shaping gain 

( 7 ( 5 )). 





At a bit error rate of 10 -5 ~ 10 -6 , the 
maximum coding gain is about 7.5 dB, and 
the maximum shaping gain is about 1.5 dB. 


Because these gains can be achieved 
independently, for coded QAM we focus on 
coding gain only and choose the signal set to 
be Z N ( N dimensional integer lattice). 

For coded MPSK, we also focus only on 
coding gain, since no shaping gain is possible. 


The phase invariant property (or phase 
symmetry) is useful in resolving carrier-phase 
ambiguity and ensuring rapid carrier-phase 
resynchronization after a temporary loss of 
synchronization. It is desirable for a coded 
modulation system to have as much phase 
symmetry as possible. 

We present necessary and sufficient conditions 
for a QAM code to be 90° rotationally 
invariant, and some 90° rotationally invariant 
multi-level codes are constructed. 



Multi-level Trellis Coding Based on Set 

Partitioning 


• Figure 1 shows a multi-level trellis coding 
- scheme based on set partitioning. A 0 is a 
signal set, A * is a subset of A;_i, and A m is 
the all-zero vector. C\, C 2 , • • • , C m represent 
the different component codes, and the 
overall multi-level code is denoted by c. 



Flg.1 Multi-level trellis coding based on set partitioning 


Mapping to signal point 







Related previous work 


Leech (1964) and Leech and Sloane (1971) 
used a multi-level structure to construct 
lattices. 

Multi-level codes using “proper indexing”, 
which is the same as Ungerboeck’s “set 
partitioning”, of two dimensional signal sets 
was proposed by Imai and Hirakawa (1977). 
They also presented a multi-stage decoding 
method using a posteriori probabilities 
based on channel statistics. 

Ginzburg (1984) designed multi-level 
multi-phase codes for a continuous channel 
by using set partitioning and algebraic block 
codes. 

Sayegh (1986) showed how Imai and 
Hirakawa’s method can be combined with 
set partitioning to create multi-level block 
coded modulation systems. 

Pottie and Taylor (1989) proposed a 
hierarchy of codes to match the partitioning 
of signal sets by generalizing Imai and 
Hirakawa’s and Ginzburg’s coding schemes. 



• Calderbank (1989) investigated the path 
multiplicity for a variety of multi-level codes. 

• Tanner (1990?)studied linking subspaces of 
vector spaces to guarantee a large minimum 
separation between signals in the resulting 
signal set so that good multi-level codes can 
be designed. 

Basic multi-level trellis codes 

• This construction is based on two-way 
partition chains, where all component codes 
are binary codes (block or convolutional). 

• Let A i be the minimum squared Euclidean 
distance (MSED) of A* for i = 0, 1, . . . , 771. 

• Let di be the minimum Hamming distance 
of binary code C{ for i = 1 , 2 , . . . , m. 

• Then the MSED of the multi-level code is 
(Leech 8z Sloane, Ginzburg, Sayegh, etc.) 

D(C) = min{rf ? A z _i, 1 < i < m) 


The normalized redundancy p(C ) is defined 
as (Forney) the number of redundant bits 
per two dimensional signal (symbol). 

The spectral efficiency 77 (C) is defined as 
(Ungerboeck) the number of information 
bits per two dimensional signal (symbol). 

Basic multi-level codes with normalized 
redunduncy p(C) = 1 bit/symbol were 
presented by Yamaguchi and Imai (1987). 

Basic multi-level codes with smaller 
normalized redundancies can be constructed 
by using two-way partition chains with 
multi-dimensional signal sets and binary 
convolutional or block codes. Some four and 
eight dimensional basic multi-level codes 
were constructed by Wu and Zhu (1990?). 

We present some new basic multi-level codes 
based on set partitioning of one and two 
dimensional signal sets. Some of these new 
codes have non-integer normalized 
redundancies p(C). 


Example 1. A three-level trellis code using 
an 8-PSK signal set with mapping by set 
partitioning is shown in Figure 2. 



Fig. 2 Multi-level code of Example 1 
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Mapping to signal point 




wr m 


• Let C\ be a 16-state rate-1/4 convolutional 
code with minimum free Hamming distance 
16, 

C 2 an 8-state rate-3/4 convolutional code 
with free distance 4, 

C 3 = P n , the (n, n— 1) single parity check code. 

• The spectral efficiency of this multi-level 
code is 

77 (C) = 1 H- (n — l)/n bits/symbol 

• The minimum free squared Euclidean 
distance is 

D(C) = min{0.586 x 16,2 x 4,4 x 2 } 

= 8 

• The nominal coding gain (Ungerboeck) over 
uncoded QPSK is 

7 (C) = 10 bg,, = 6.0UB. 

• The 256-state, rate-2/3, 77 (C) = 2 bits/symbol 
Ungerboeck code has D(C) = 7.515 and 

7 (C) = 5.75 dB. 
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Multi-Stage Decoding of Example 1 


• A three-level multi-stage decoder for Example 
1 is shown in Figure 3. 



Fig. 3 Multi-stage decoding for Example 1 


n 







• The normalized complexity iVp of 
multi-stage decoding is the number of 
required binary operations (additions and 
comparisons) per 2 dimensional symbol. 

• For a 2^-state, k input bit, n output bit 
convolutional (trellis) code, the 
Add-Compare-Select (ACS) operation of the 
Viterbi algorithm requires 2 k additions and a 
comparison of 2 k numbers, or 2 k — 1 binary 
comparisons, for each of the 2 V states, so its 
complexity is 2 k+v+l — 2 V . (This number 
should be normalized to the complexity per 
2 dimensional symbol.) 



First-stage of Decodin 


• For each state transition period, the symbol 
metrics of both QPSK subsets (see Figure 4) 
must be computed. 

Complexity = 2 binary operations/symbol 
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• Then the branch metrics within each state 
transition period must be computed by 
adding the four symbol metrics on each 
branch. 

Complexity = 6 binary operations /symbol 

• The ACS operation of the Viterbi algorithm 
is then used to determine the surviving path 
at each state. 

Complexity = 12 binary operations/symbol 
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Second-stage of Decodin 



• The decoded information from the first stage 
is passed on to the second-stage. 

• For each state transition period, the symbol 
metrics of both BPSK subsets (see Figure 5) 
must be computed. 

Complexity = 2 binary operations /symbol 



(a) BPSK signal set (b) BPSK signal set 

aibt=00 aibi=oi 


Fig.5 
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Then the branch metrics within each state 
transition period must be computed by 
adding the four symbol metrics on each 
branch. 

Complexity = 6 binary operations /symbol 

The ACS operation of the Viterbi algorithm 
is then used to determine the surviving path 
at each state. 

Complexity = 30 binary operations/symbol 

If the parallel transitions in the trellis are 
resolved by table-look-up, the complexity 
reduces to 14 binary operations/symbol. 



Third-stage of Decoding (assume n = 32 ) 


• The decoded information from the first and 
second stages is made available to the third 
stage. 

• For each state transition period, the metrics 
of both the 0 and 1 symbols must be 
computed. 

Complexity = 2 binary operations/symbol 

• In this case, the branch metrics are the 
symbol metrics computed above (one symbol 
per trellis branch). 

• After 8 branches (32 symbols) in the first 
and second trellis are decoded, the Viterbi 
algorithm is used to make a decoding 
decision for the block code C3 = p 32 . 
Complexity = 6 binary operations/symbol 

• The total decoding complexity is Np = 66 
binary operations per 2 dimensional symbol, 
or Np = 50 not counting the parallel 
transitions. 
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If we take C 3 to be P n , where n — ► 00 (i.e., a 
2 -state, non-redundant, catastrophic trellis 
code), the multi-level code has 1 + 3 + 4 = 
8 input bits and 4 + 4 + 4 = 12 output bits 
for every four 8 -PSK transmitted symbols. 
Overall, this can be viewed as a 16 x 8 x 2 
= 256-state 8 -dimensional trellis code. 

Without considering the computation of the 
symbol and branch metrics, the ACS 
complexity of maximum likelihood decoding 
of the overall trellis code is 

( 2 8+8+i _ 2 8)/4 = 2 15 - 2 6 > 3 x 10 4 

binary operations /2 dimensional symbol. 

Note that the complexity of the multi-stage 
decoder in this example is only about 0 . 2 % 
of the complexity of the overall maximum 
likelihood decoder. 

However, the performance of the multi-stage 
decoder is close to that of the maximum 
likelihood decoder. 

For the 256-state Ungerboeck code, the ACS 
complexity alone is 1792 binary 
operations / symbol. 


• Example 2. The one dimensional partition 
chain Z/2Z/4Z/... has MSED 1/4/16/ ... (see 
Figure 6). 


...00 ...01 ...10 ...11 ...00 ...01 ...10 ...11 



...01 ...11 ...01 ...11 
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Fig.7 Multi-level code of Exemple 2. 


» Let Ci be a 16-state rate-1/4 convolutional 
code with minimum free Hamming distance 16, 

_ C 2 be an 8-state rate-3/4 convolutional code 
with free distance 4, 

and C 3 ,C 4) ... be rate-1 codes (no coding). 

• Since there are two levels of coding, this is 
~ a two-level code (see Figure 7). 

-• The normalized redundancy p(C ) is 2 bits 
per symbol. 

• The MSED is 

D{C) = min{l x 16, 4 x 4, 16} = 16 
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• The nominal coding gain (Forney) is 

7 (C) = 101o glo |^ = 6.02(dB) 

• This code has the same nominal coding gain 
and normalized redundancy as the 
24-dimensional Leech lattice A 24 but much 
less decoding complexity. 

• Due to a large path multiplicity, the effective 
coding gain of this two-level code is less than 
the nominal coding gain. To reduce the path 
multiplicity, we can choose longer 
convolutional codes (with larger constraint 
lengths and free distances). 

• For example, if C\ is a 32-state rate-1/4 
convolutional code with free distance 18 and 
C 2 is a 32-state rate-3/4 convolutional code 
with free distance 5, the path multiplicity is 
reduced and the effective coding gain is 
closer to 6.02 dB. 
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^sing multi-stage decoding, an additional 
ss of coding gain occurs, but the decoding 
omplexity is less than a 64-state 
_ngerboeck code and much less than the 
,eech lattice A 24 . 


5le 1 . Comparison of multi-level trellis codes 
Li other codes (spectral efficiency 77(C) = 4 
^/symbol) using 8 -PAM modulation 
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^tie decoding delay of a multi-level trellis code 
1 proportional to 

D±±zNiKi, 

/_iere iV z is the dimensionality of the signals 
closets) associated with a branch transition of 
Ge zth component code and K[ is the 
c nstraint length of the ith component code. 
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Multi-level trellis codes based on a set 
partition chain with strictly increasing distances 


• Multi-level trellis codes using 
multi-dimensional signal sets can achieve 
higher spectral efficiencies (lower normalized 
redundancies) than multi-level codes based on 
two dimensional signal sets. 

• For two-way partitioning of multi-dimensional 
signal sets, the MSED at successive partition 
levels may be equal. For example, the 
partition chain Z 4 /D 4 /i?Z 4 /i?Z? 4 /2Z 4 /2A/ . of 
the four dimensional integer lattice Z 4 has 
distances 1/2/2/4/4/8/ ..., where R represents 
the rotation operation, R 2 — 2, and D 4 is the 
densest known four dimensional lattice. 

• Reducing the number of component codes can 
reduce the decoding delay and the path 
multiplicity. 
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• Some partition levels can be joined to form a 
new multi-way partition chain with strictly 
increasing distances. For example, the 
partition chain Z^ / D^/ RD^/2D^/ . . . has 
distances 1/2/4/8/.... Since \Z^/D^\ — 2 and 
\R l D^/ R l+l D^\ = 4 for i = 0, 1 , 2, . . the first 
component code can be a binary code, and 
other component codes can be binary input, 
4-ary output codes or codes over GF( 4). 

• The lower bound on the MSED of these 
multi-level codes is given by 

D(C) > min{diA t *_i, 1 < i < m} 

where d{ is now the minimum free Hamming 
distance of code (binary or 4-ary). 
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Example 3. This code is based on the partition 
chain Z A / D±/ RD±/ . . . and includes two component 
codes (see Figure 8): 

C\ is an 8 state rate-3/4 convolutional code with 
free distance 4 and C<i is an (N, N-l) block code 
over GF(4) with minimum distance 2 (4 states). 

• The normalized redundancy is p(C ) = 8+& the 
MSED is 4, and the nominal coding gain is 

S 01 

7 (C) = 5.64 - — (dB) = 5.48 dB (N = 19) 


• The decoding complexity is Njj = 37, and the 
decoding delay is D = 24 (excluding the 
decoding delay of the block code). 



Fig. 8 Multi-level code of Example 3. 

• The 64-state, rate-4/5 Ungerboeck code for Z 4 
has 7 (C) = 5.48 dB, Np « 496, and D = 12 . 
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Combined Ungerboeck-type and multi-level 

trellis codes 


• For the above two classes of multi-level codes, 
each output symbol of a component encoder 
corresponds to a single coset of a subset of a 
signal constellation (two dimensional or 
multi-dimensional). For Ungerboeck-type 
codes, all the encoder output symbols 
associated with a single trellis branch 
correspond to a single coset of a subset of a 
signal constellation. Ungerboeck-type codes 
can be used as component codes at some levels 
in conjunction with a multi-way partition 
chain. 

• Instead of using several high rate codes at 
higher levels of partitioning, we use an 
Ungerboeck-type code to reduce the decoding 
delay and path multiplicity. 

• The usual lower bound on the MSED cannot 
be applied to this construction. A more 
general lower bound on the MSED of these 
multi-level codes (Kasami &; Lin) is given by 

D(C) > min{D(Cy, 1 < i < m} 
where D(C t ) is the MSED of code C { . 


26 



Example 4. The encoding structure is shown 

in Figure 9. 

• Let C\ be a 16-state rate-1/4 convolutional 
code with minimum free Hamming distance 16, 


C 2 a 16-state rate-7/8 trellis code with MSED 
8 (Pietrobon, Deng, et.al., 1990). 



Fig. 9 Multi-level code of example 4. 

• The 64-state, rate-4/5, 77 (C) = 2 , 4 x 8 -PSK 
code constructed by Pietrobon, Deng, et.al. 
(1990) has 

D(C) = 7.029, 7 (C) = 5.46 dB , No ~ 496, and 
D = 12 . 
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Encoding procedure: 

The information sequence is divided into 
blocks of 8 bits each: 

the first bit in each block enters encoder Ci, 
and the 4 output bits specify 4 consecutive 
cosets of 4x( 8-PSK/QPSK), 

the other 7 bits of the block enter encoder C<i 
and the 8 output bits specify a 4x QPSK 
signal. 

The spectral efficiency of this multi-level code is 
77 (C) =8/4 = 2 bits/symbol 

The MSED is 

D(C) = min{16 x 0.586,8} = 8 
where D(C\) = 16 x 0.586. 

The nominal coding gain over uncoded QPSK 
is 7 (C) = 6.02 dB. 

The decoding complexity for multi-stage 
decoding is N& ~ 100 binary operations per 
symbol. 

The decoding delay is only D = 16, which is 
less than a multi-level code with more stages. 



Generalized multi-level trellis codes 


• The previous examples were all based on 
Ungerboeck’s set partitioning. A modified set 
partitioning method can be used to construct 
generalized multi-level trellis codes. 

• Example 5. The four dimensional 8-state code 
C(Z A / RD 4 ) constructed by Wei (1987) has 
MSED 4. Mapping the same binary code to 
RZ^j 2 D\ rather than Z^/RD^ we obtain a 
trellis code, denoted by C 2 (RZ 4 / 2 D±), with 
MSED 8. Using an 8-state rate-1/3 
convolutional code as the first component code 
C\(Z 2 / RZ 2 ) and C 2 (RZ 4 / 2 D i ) as the second 
component code gives the two-level trellis code 
shown in Figure 10. 



Fig. 10 Multi-level code of Example 5. 
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• Encoding procedure: 

The information sequence is divided into 

blocks of a specified number of bits according 

to the desired spectral efficiency: 

the first 2 bits in each block enter encoder Ci, 

and the 6 output bits specify 6 consecutive 

cosets of Z 2 /i?Z 2 , i.e., 3 consecutive cosets of 

Z 4 /i?Z 4 , 

the next 6 bits of the block enter encoder C<i-> 
and the 9 output bits specify 3 consecutive 
cosets of i?Z 4 /2jD 4 . 

Together with uncoded bits, each coded block 
determines 3 consecutive four dimensional 
signals, i.e., 6 two dimensional signals. 

• Note that the first coding level partitions a six 
dimensional signal set whereas the second 
coding level partitions a four dimensional 
signal set. 

• The nominal coding gain is 7 (C) = 5.52 dB, 
which is 1.00 dB greater than Wei’s code. 

• The decoding delay of this two-level code is 
D = 15, whereas the delay of Wei’s code is 
D = 6. 

• The decoding complexity of this two-level code 
is N d = 56, whereas the complexity of Wei’s 
code is N d = 44. 
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Example 6. Consider the generalized multi-level 
trellis code shown in Figure 11. 

The first component code, associated with the 
partition Z/2Z, is a 32 state rate-1/2 convolu- 
tional code with free distance 8. 

The second component code, associated with 
the partition 2Z S /2D$, is a single parity check 
block code of length N. 



Fig. 1 1 Multi-level code of Example 6. 
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• Encoding procedure (spectral efficiency = m 
bits/ symbol): 

• The information sequence is divided into 
blocks of 4Nm bits each, with three 
subsequences of length 4N, N — 1, and 

4 Nm — 4N — (N — 1) corresponding to Ci, C 2 , and 
uncoded bits, respectively. 

• Each output bit of encoder C\ specifies a coset 
of partition Z/2Z, i.e., SN output bits specify 
N cosets of Z 8 j2Z 8 . 

• Each output bit of encoder C 2 specifies a coset 
of 2Z 8 /2Dg, i.e., N output bits specify N cosets 

of 2Z 8 /2D 8 . 

• Together with the 4Nm — 4 N — (N — 1) uncoded 
bits, each coded block of N eight dimensional 
signals, i.e., 4N two dimensional signals 
contains 4 Nm bits of information and the 
spectral efficiency in m bits/symbol. 
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• The normalized redundancy is p(C ) = 1 + 4 ^ 
and the MSED is 8 . Therefore the nominal 
coding gain is 

S 01 

7 (C) = 6 . 02 -— (dB). 


• The decoding complexity is Np = 140 and the 
decoding delay (excluding the block code) is 
D = 5. 

• The 128-state, rate-4/5 Ungerboeck code for 
Z 8 has 7(C) = 5.27 dB, number of nearest 
neighbors Nf ree = 112, Njj ^ 992, and D = 28. 
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• In general, let Ao be a signal set and Ag be a 
set such that Aq x • • • x Ao = An^ x • • • x Aq , 

s V ^ N ■■ V — ' 

JO ^0 

for some integers jo, ko > 1. 

• If there are 2m sets A^i and A^, for 

i = 1, 2, . . . , ra, where A^) is the empty set, 
satisfying the following conditions: 


(1) Afc x) x ••• x A^ = A t --i x ... x A&, 


(•’- 1) _ A (0 


(0 


ji 

for i = 2, 3, . . . , to, and for some ji , k{ > 1 ; 

(2) A^x Z) A t W, for i = 1, 2, . . . , to; 

then we can construct a multi-level code 

having the form shown in Figure 12: 
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Fig. 12 The generalized multi-level coding scheme 


• The MSED of this multi-level code is lower 
bounded by 

D{C) > min{Z?[C'j(A2 1 /Ai l) )], 1 <i <m} 

where !>[<?, -(A^/A^)] is MSED of the ith 
component code. 
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Mapping to signal point 








Level spanning multi-level trellis codes 


• Level spanning provides an approach to 
constructing rotationally invariant multi-level 
trellis codes. 

• However, the lower bound on MSED of 
generalized multi-level codes may not hold for 
this class of codes. 

Example 7. Consider the multi-level coding scheme 
shown in Figure 13. 



Fig. 13 Four dimensional multi-level trellis code 
with level spanning of Example 7 
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• Ci is a 16-state rate-2/3 Ungerboeck code, 
which has MSED 6 when used with the 
partition Z 2 / RZ 2 /2Z 2 . 

• C 2 is an 8 -state rate-7/8 binary convolutional 
code with free distance 3. 

• C 3 is a 2 -state ( 8 , 7) block code with minimum 
distance 2 . 

• Encoding procedure (spectral efficiency = m 
bits/symbol): 

• The information sequence is divided into 

blocks of 16m bits each, with four 
subsequences of length 16, 7, 7, and 16m - 30 
corresponding to and uncoded bits, 

respectively. 

• Each state transition period of encoder C\ 
outputs three bits which specify cosets of the 
partitions Z 4 / iJZ 4 , and RD\j2Z^, 
respectively, i.e., 24 output bits specify 8 
cosets of each partition. 
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• Each output bit of encoder C2 specifies a coset 
of i?Z 4 /i?D 4 , i.e., 8 output bits specify 8 cosets 
of RZ*/RD±. 

• Each output bit of encoder C3 specifies a coset 
of 2Z 4 /2D 4 , i.e., 8 output bits specify 8 cosets 

of 2Z 4 /2D 4 . 

• Together with 16m - 30 uncoded bits, each 
coded block of 8 four dimensional signals, i.e., 
16 two dimensional signals, contains 16m bits 
of information and the spectral efficiency is m 
bits/symbol. 

• Since the MSED’s ,of Z 4 ,D 4 , and RD± are the 
same as Z 2 ,i?Z 2 , and 2 Z 2 , respectively, the 
MSED of C\ is the same as the corresponding 
Ungerboeck code, i.e., D(C\) = 6. Therefore, 
assuming the lower bound on MSED holds in 
this case, D(C) = min{6, 3 x 2,2 x4,8} = 6. 

• The normalized redundancy is p(C) = 5/8, the 
nominal coding gain is 7 (C) = 5.90 dB, the 
decoding complexity of multi-stage decoding is 
Np = 108, and the decoding delay is D = 56 . 

• However, due to the uncertainty regarding the 
bound, the actual values of D(C) and 7 (C) may 
be less than stated above. 
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• It can be shown that the two bits 
corresponding to the partition levels D 4 / RZ 4 
and RD 4 / 2 Z 4 are the only ones affected by a 90° 
phase rotation. So this code can be combined 
with a differential encoder to achieve 90° 
rotational invariance as shown in Figure 14. 



Fig. 14 Diagram of four dimensional 90 rotationally 
Invariant encoder with a differential encoder 
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Conclusions 


• Several constructions for multi-level trellis 
codes are presented and many codes with 
better performance than previously known 
codes are found. These codes provide a 
flexible trade-off between coding gain, 
decoding complexity, and decoding delay. 

• New multi-level trellis coded modulation 
schemes using generalized set partitioning 
methods are developed for QAM and PSK 
signal sets. 

• New rotationally invariant multi-level trellis 
codes which can be combined with differential 
encoding to resolve phase ambiguity are 
presented. 
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Appendix B 

New Multi-Level Codes over GF{q) 


